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Abstract 

To solve the combinatorial optimization problems especially the minimal Vertex-cover prob- 
lem with high efficiency, is a significant task in theoretical computer science and many other 
subjects. Aiming at detecting the solution space of Vertex-cover, a new structure named mutual- 
determination between unfrozen nodes is defined and discovered for arbitrary graphs, which results 
in the emergence of the strong correlations. Based on the backbones and mutual-determinations 
with node ranks by leaf removal, we propose an Mutual-determination and Backbone Evolution 
Algorithm to achieve the reduced solution graph, which provides a graphical expression of the 
solution space of Vertex-cover. By this algorithm, the whole solution space and detailed structures 
such as backbones can be obtained strictly when there is no leaf-removal core on the graph. Com- 
pared with the current algorithms, the Mutual-determination and Backbone Evolution Algorithm 
performs better than the replica symmetry ones but has a small gap higher than the replica sym- 
metric breaking ones, and has a relatively small error for the exact results. The algorithm with 
the mutual-determination provides a new viewpoint to solve Vertex-cover, by which all detailed 
information of the ground/steady states can be shown in the reduced solution graph. 
Keywords: Vertex-cover; Solution space; Mutual-determination; Backbone. 
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INTRODUCTION 



The minimal vertex-cover problem (Vertex-cover) belongs to one of Karp's 21 NP- 
complete problems [1] and the six basic NP-complete problems |2|, |3|], which is considered 
as one of the classical problems in theoretical computer science. The aim of this problem is 
to mark a minimum subset of vertices such that there are at least one vertex of each edge 
in the subset. There are a large number of applications of this problem in the related real 
networks, such as immunization strategies in networks [4] and monitoring of internet traffic 

There is a threshold behavior of the minimum vertex-cover problem on the Erdos-Renyi 
random graph [6]. It means that the typical running time of algorithms changes to expo- 
nential from polynomial when the order parameter becomes lager than the Euler number 
. This phase transition phenomenon is considered to have intrinsic correspondence 
with the clustering structure of solution space which have already been observed in statis- 

iTn 

tical physics when studying spin glasses |9|, HO]. Although most statistical physicists believe 
that the clustering structure leads to the failure of replica symmetry, the details of the re- 
lation between searching solutions and the structure are not well established, and how the 

nn 

clustering structure looks like is far from being clear for most models jlll-ll3[|. From an 
algorithmic point of view, the solutions' structure makes great effects on the algorithm to 
find the solutions, which sets barriers to local searching algorithms and makes the compu- 



tation expensive 
approaches. Til 
and frustration 
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15| . So the features of solutions' structure are explored by different 
now, some typical structures such as clustering, backbone, backdoor [lej] 
have been widely investigated to understand the structure of solutions 



more clearly. Especially, H. Zhou 



18| has proposed the long-range frustration structure 
and F. Krzakala ll9| has provided a formal definition as long-range correlation. The long- 
range correlation and bakbone structures are treated as the origin of the replica symmetric 
breaking and the high computational complexity. And, based on the analysis of these typi- 
cal characteristics of the solution space, many efficient searching algorithms are proposed to 



solve NP-complete problems, such as Belief Propagation and Survey Propagation |2o[j22|. 

In this paper, a mutual- determination structure is proposed by statistical mechanic ap- 
proach to investigate the solution space of the minimum vertex-cover problem. This struc- 
ture refiects the feature of the Hamming distance 0, Q among solutions and describes how 



tight the correlations among unfrozen variables are. By this structure, we can detect the 



equivalent variables in the solution space 



25| . i.e., the variables must take the same or the 



opposite Boolean values. Furthermore, based on the existence of the mutual-determination 
in the solution space of Vertex-cover, the ranks of nodes of a graph by the leaf-removal 
process are provided to describe the influence orders of leaves in different levels. Taking the 
advantage of the leaf-removal ranks and the relationship of mutual-determination with the 
backbone and unfrozen variables, we can have a much clear understanding of the evolution 
of the states in the solution space when a new node is added, and a reduced solution graph is 
defined to exactly express the structural information of the solution (sub-) space. Finally, an 
algorithm named Mutual- determination and Backbone Evolution Algorithm is proposed by 
the evolution of the mutual-determinations and backbones on the reduced solution graph, 
and some analysis and numerical experiments are given to verify its efliciency and adapt- 
ability. This algorithm is complete to flnd the whole solution space of Vertex-cover when 
there is no leaf-removal core in the graph, otherwise an approximated one with relatively 
better efliciency than the replica symmetry methods. 



DEFINITION OF INTERACTION 



A vertex cover on an undirected graph G{N^ M) with nodes and M edges is a subset 
= {^1, ^2, • • • 5 ^m} of its nodes such that every edge has at least one endpoint in S. The 
minimum vertex-cover problem is an optimization problem to flnd the minimum size of a 
vertex cover on a given graph. Mapped to spin-glass model, energy function of the minimum 
vertex-cover problem can be written as 

N 

where E{G) denotes the edge set and (i,j'')s are edges in it, spin/variable = —1 if node 
i G S (covered) and = 1 otherwise. Then, different energy levels are produced by different 
assignments or configurations in terminology of spin-glass theory. The assignments with the 
lowest energy are named solutions /ground states^ and the set of all these solutions achieving 
the lowest energy (minimum vertex cover) is named solution space S. 

Backbones [16] and long-range correlations Q are both the typical structures of 
solution space of combinatorial optimization problems, which have been well studied in 
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algorithmic and statistical analysis. In the solution space 5, spin is frozen or called 
backbone if it takes the same value in all solutions; otherwise it is unfrozen. For an unfrozen 
spin (7^, if it taking some value will make influence on inflnite number of other spins (assumed 



0{N) with the total number of spins), it belongs to long-range correlation 
Recent research suggests that the complicated organizations of the solutions of combinatorial 
optimizations, e.g., backbones and long-range correlations, would be the kernel reason for the 
algorithmic hardness to flnd a solution for large-scale combinatorial optimization problems 
with massive constraints and variables [26]. To study the solution space S of Vertex-cover, 
we classify the variables as unfrozen, positively frozen (frozen to +1) and negatively frozen 
(frozen to —1) variables. 



As a generalization of the backbone and long-range correlation, a new structure named 
mutual- determination is proposed to achieve a better understanding of the solution space, 
which can be viewed as an interactive relation of unfrozen variables in the solution space. If 
two unfrozen variables form a mutual-determination, the flxation of the assignment of any 
one will result in the flxation of the other in the solution space. Indeed, it is a special relation 
implied by the constraints that two unfrozen variables can be mutually determined by each 
other, i.e., if two unfrozen variables form a mutual-determination, then + aj = 0. 

When two unfrozen nodes form mutual-determination for Vertex-cover, it means that if one 
of them is covered, the other should be uncovered, and there is one and only one should be 
covered for this pair of nodes. 



By the famous survey propagation algorithm [2l|], it takes advantage of the idea of the 
backbone and long-range correlation to gradually eliminate variables and constraints of 
the original problem in size, and achieves excellent performance for solving 3-SAT, Vertex- 
cover, etc. As the motivation for proposing the mutual-determination structure and for 
that the variables in interactive relations are equivalent variables, we can use a simple 
logic CTj = —ai to decrease the number of variables in the original problem to obtain new 
algorithmic strategies. In the following sections, we will use the backbones and mutual- 
determinations to analyze the solution space of Vertex-cover. 




FIG. 1. The subgraph (1) is the original graph and the subgraph (!') reflects the leaf removal 
process. For the original graph (1), nodes {a, 6, c} form a multiple leaf with the common petiole c 
and the corresponding edges are marked by black dashed lines; after removing this leaf, a new leaf 
with nodes {d, e} appears and the corresponding edges are marked by red dashed lines; when leaf 
{d, e} is removed, the last new leaf {/, g} is produced and the corresponding edges are marked by 
green dashed lines. The subgraphs (2-4) reveal the relationship of nodes in the leaves of a graph. 
There are three leaves in the graph which are marked by the red rectangles in subgraph (2-4), and 
the relations among the nodes are revealed by the constraints in the leaves for Vertex-cover. 



REDUCED SOLUTION GRAPH OF VERTEX-COVER 



To study the solution space of Vertex-cover, the leaf removal 29| should be mentioned as 
inspiration. Given a graph G, a leaf is a couple of nodes {v^w} in which the first one has 
degree 1 and the second one is the only neighbor of it. Here, node v is a. pendant point in 
the graph, node w acts as a petiole, and for the same petiole there may be more than one 
pendant points connecting it. To define the leaf removal^ if the nodes pair {v^w} is a leaf 
in graph G, remove the two nodes with the edges touching them. It is very interesting that 
the leaf removal process can destroy all the leaves in graph G and can produce new leaves 
for the rest graph. In Figure 1, a leaf removal process for a simple graph is shown. 

By this leaf removal process, we can find that there exist some graphs which have no leaf 
removal core until the termination of this process, which means that each node belongs to a 
leaf in the graph. For the Vertex-cover of these graphs, to obtain the minimum vertex cover 
for the graph, there is one and only one node should be covered for each leaf. By the results 



in j29|], a trivial minimum vertex cover can be obtained by making all the petioles covered 
with all the pendant points uncovered in different levels of leaves, e.g., making the nodes 
{c, e, g} or {c, e, /} covered and the rest uncovered leads to minimum vertex covers. Here, 
we will take use of this trivial solution to construct a relationship between/among nodes in 
a leaf. 

In Figure 1, the first subgraph (1) is the original graph. For the first leaf {a, 6, c} in this 
graph which lies in the red rectangle of subgraph (2), there are two pendant points with 
one petiole, and to ensure the minimum coverage of the subgraph of {a, 6, c}, the only way 
is to cover the petiole node c and make the two pendant points {a, b} uncovered. In this 
case, the node c acts as a negatively frozen node (backbone), which is marked by solid black 
circles, the node a, b acts as a positively frozen node, which is marked by solid red circles, 
and the edges connecting them are marked by dashed ones. For the second leaf {rf, e} in the 
red rectangle of subgraph (3), there is only one pendant point d and one petiole e, to ensure 
the minimum coverage of the subgraph of {a, 6, c, rf, e}, covering any node of {rf, e} with the 
other one uncovered will make an optimization solution. In this case, the assignments of 
cr^i, cTg must be opposite and they are mutually determined in the solution space of Vertex- 
cover, which is denoted by a double edge and two nodes with different colors. For the third 
leaf {g^f} which is similar as the leaf {rf, e}, their relation is also mutually determination. 
However, the relation of {g^f} makes influence on the leaf {rf, e}, which makes the states 
of nodes {rf, e} changed to be backbones, and the detailed techniques for this case will be 
discussed in the following sections. 

Based on the analysis inspired by the example in Figure 1 and the backbone and mutual- 
determination structures, we can construct an expression of the solution space of Vertex- 
cover which named reduced solution graph S{G): to show different minimum vertex covers 
of a given graph G, the backbones on it are marked by solid red or black circles, and double 
edges between unfilled hollow nodes with different colors (blue and green) suggest that the 
relations between the nodes are mutual-determinations and they can not take the same 
value simultaneously; the edges connecting the backbones will be changed to dashed ones 
and the edges connecting two unfrozen nodes are retained. By the leaf-removal process and 
the strong correlation among/between nodes in the leaves, the mutual-determination can 
only be in the pendant point and its petiole. Then, it is evident that the reduced solution 
graph can express the solution space of Vertex-cover strictly when there is no leaf removal 
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core for the given graph, and whether this expression is also effective for general graphs 
with leaf-removal cores and how to obtain the reduced solution graph of Vertex-cover will 
be discussed in the following. 

In order to have a convenient analysis of the reduced solution graph, the leaf-removal [29] 



sequence is very important. Here, we take advantage of the sequence of the leaf removal to 
define the rank of each node: 

Step 1: All the pendant points in the graph are assigned to sequence order/rank 1, and 
their neighbors (the petioles) have rank 2; 

Step 2: Remove the leaves with edges connecting them from the graph. After the leaf 
removal, all the new produced pendant points are assigned to rank 3, and their corresponding 
petioles have rank 4; 

Step 3: Repeat the steps 1-2 and assign increasing ranks until their are no new leaves 
produced. If there is still a leaf-removal core after the above two steps, assign the nodes in 
the core with ranks according to their already ranked neighbors by gradually increase. 



ANALYSIS OF MUTUAL-DETERMINATION IN THE SOLUTION SPACE OF 
VERTEX-COVER 

In this section, we concern on achieving the reduced solution graph S{G) by determining 
the states of the nodes one by one following the leaf removal sequence/ranks. This process is 
fulfilled by a method similar to the cavity method, and for each node its state is determined 
by the local environment of itself. Considering a new node i connected to a graph G with 
k edges, the newly produced graph is denoted by G^ For the neighborhood of node i, there 
are three kinds of neighbors: positively frozen ones, negatively frozen ones and unfrozen 
ones. 



Local evolution of mutual-determinations and backbones 

In this subsection, we consider the diflFerent local environments of a new node and inves- 
tigate the state determination and evolution of it and associated nodes. Taking advantage 
of the analysis in [18], we first study the following four cases: 

• Case A: only one of its neighbors is positively frozen in G; some other neighbors are 
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unfrozen nodes which can take spin value —1 simultaneously. 

In case A, energy increase is unavoidable when node i is added. When cr^ takes value 

— 1 (covered), its neighbors of nodes are free to take their spin values in the original G, and 
new covers of the new graph come out with the lowest energy; when takes value 1, the 
positively frozen neighbor should be changed to an unfrozen node taking —1 now, e.g., adding 
the node e to the subgraph of {a, 6, c, d} leads a mutual-determination of {d, e} in Figure 1 
and the above subgraph in Figure 3 also show this process. Then, mutual-determination of 
the new added i with the original positively frozen node j is formed. 

• Case B: there are more than two neighbors which are positively frozen. 

In case B, energy increase is unavoidable when node i is added. To obtain a coverage of the 
new graph from the original one G, the new added node i must be covered without other 
choice. Then, node i is negatively frozen. (There will be a supplementary and additional 
adjustment for this case in the following case E when the positively frozen neighbors have 
some common properties.) 

• Case C: there is no neighbor which is positively frozen, but all the unfrozen neighbors 
can take spin value —1 simultaneously. 

In case C, energy increase is avoidable when node i is added, and the new added node 
i should be uncovered. When cr^ takes value +1, all the unfrozen neighbors should take 

— 1 simultaneously. Then, by the mutual-determinations and coverage of each edge in the 
reduced solution graph <S(G), that these unfrozen neighbors change to be negatively frozen 
will lead a number of associated unfrozen nodes to be frozen. 

• Case D: there is at least one pair of unfrozen neighbors that can not take spin value 

— 1 simultaneously. 

In case D, as the two neighbors can not take —1 simultaneously, energy increase is in- 
evitable. Then, the new added variable i should take —1 to ensure the coverage. However, 
for the incompatible cycles (like that in the below subgraph of Figure 3), making any other 
node except i frozen to —1 and the rest unfrozen nodes connected by alternatively existing 
double edges will have the same effect and ensure the coverage. Thus, in case D freezing the 
new added node i to — 1 will reduce the whole solution space to a partial solution subspace. 
Nevertheless, as takeing any one to be frozen on the incompatible cycle leads to a solution 
subspace with the same size, we have the convenient way to make i negative backbone. 

By the above analysis, the incompatible cycle in the reduced solution graph makes a 
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possible inaccurate choice of the negatively frozen backbone. Thus, the hardness of solving 
Vertex-cover mainly stems from the incompatible cycles. 

There exists an interesting entanglement between case A and case C. In case C, some 
added node ii has a positively frozen state, its unfrozen neighbors are forced to be frozen 
with some associated nodes. In case A, if some new added node ^2 is connected to ii and 
forms mutual-determination with ii by the rule of case A, the nodes that have been frozen 
by ii should be released to their original unfrozen state. To fulfill this releasing steps, an 
additional mark should be sticken to the node number, e.g., a node (4,7) means that the 
node 4 has been frozen by the operation of adding node 7. Indeed, this freezing influence 
happens only in case C with node 7 positively frozen. Then, if the state of node 7 is changed 
to be unfrozen by adding a new node 8 in case A, we can release all the nodes with mark 
(*,7) and change the corresponding numbers to (*,0), in which means the state of the 
node is unfrozen. This operation is named releasing operation. 

For the releasing operation, there is a special case should be considered for the node 
adding process: 

• Case E: there are more than two neighbors which are positively frozen and have the 
same additional mark, and the unfrozen neighbors can take spin value —1 simultaneously. 
This case is a supplementary and additional adjustment of case B. 

In this case, the current node should form mutual-determinations with the positively 
frozen nodes whose additional marks are the same, and the releasing operation is operated 
for these positively frozen neighbors (a simple example can be seen in the below subgraph 
of Figure 7) . 

Some supplementing techniques for the states evolution 

In the releasing operation for case A, to avoid some possible mistakes, a checking technique 
should be considered. When releasing the negatively frozen backbones in the releasing 
operations for case A, its local environment should be considered, and if there are positively 
frozen neighbors for the current negatively frozen backbone whose additional mark is not 
same as itself, the releasing process should be stopped (e.g., the node b in the process of 
subgraphs (3-4) in Figure 2). 

Be specific to this checking item, after the operations of case A-D, a rechecking technique 
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(d,0) (/,0) id,0) (/,0) 



FIG. 2. An example for the emergence of odd cycles of unfrozen nodes and the way to break this 
conflicted cycle. Subgraph (1) provides the original graph for Vertex-cover; subgraph (2) describes 
the process of adding the nodes {a, 6}, which consists a procedure of case A to produce a mutual- 
determination; subgraph (3) describes the process of adding the nodes {c, d}, which consists a 
procedure of case C to produce a positively frozen backbone; subgraph (4-5) is for adding e and 
/ separately, which consists a procedure of case A again, and the checking technique works when 
adding e and the rechecking technique works when adding /; subgraphs (6-7) correspond the 
process of adding ^, /i, which is obtained by case A and C, and the freezing influence work when 
adding g and the releasing operation works when adding /i; subgraph (8) is obtained by breaking 
the odd cycle to obtain the real reduced solution graph, which changes the node b with lowest rank 
to be negatively frozen. 

should be added: when the freezing influence and releasing operations of adding a new node 
have been done, we should check any of the negatively frozen backbone whose additional 
mark is not 0, if there is only one positively frozen neighbor for itself, release the negatively 
frozen backbone with the only positively frozen neighbor and the nodes which have the same 
additional mark with it (e.g., the node b in the process of subgraphs (4-5) in Figure 2). 

At last, by the process of above analysis, a complicated structure-odd cycles on the re- 
duced solution graph could come into appearance, which makes conflictions for the relations 
among the unfrozen nodes. For the example in Figure 2, the subgraphs (1-7) provide the 

10 



process from the original graph to the reduced solution graph by adding the nodes one by 
one using our techniques above, but unfortunately the unfrozen nodes 6, c, rf, e, /, h in sub- 
graph (7) form an odd cycle. In the odd cycle, we find that any node except b taking any 
value will force the node b to be negatively frozen, and it is an incompatible cycle. To break 
this disharmony, the only way is to change the state of b to be negative backbone and make 
corresponding changes for its neighbors with lower ranks (e.g., the process from subgraph 
(7) to (8) in Figure 2). This technique is named odd cycles breaking. 

Global characteristics of mutual-determinations 

In the following, we will have an explicit discussion of the mutual-determinations and 
unfrozen nodes structure of Vertex-cover. As mentioned above, if some node i forms mutual- 
determination with a node j, i.e., ai — —1 forces aj to take +1, correspondingly by the 
Vertex-cover, we have that — +1 requires aj — —1 to satisfy the coverage. If a node j 
forms a mutual-determination chain with some other nodes jo^ji^ ' ' ' ^ possible way is 
that the edges (j, jo)? {ji^j2)^ • • • on the reduced solution graph are all double edges, i.e., all 
these pairs of nodes form mutual-determinations, which is shown in the Cycle 2-Compatible 
Cycle in Figure 3. When the node j takes vale —1 (covered), the nodes jo^j2, ' ' ' ,j2h' ' ' 
must take +1 by the mutual-determination relations and coverage of the edges connecting 
them, and the nodes ji, js, • • • , * * * must take —1. Therefore, the alternatively existing 
double edges on the reduced solution graph lead to the emergence of the strong correlation 
for nodes of long distance. 

Without confusion, we neglect the backbones in the reduced solution graph but keep the 
unfrozen nodes. As we know, there are almost no local cycles on random graphs and the 
cycle sizes on random graph are of 0{logN). By this characteristic of random graph, the 
emergence of the Cycle 2- Compatible Cycle in Figure 3 leads to the long-range correlation 
structure, and indeed the alternating mutual-determination chain is the only way to produce 
the long-range correlation in Vertex-cover. 

When the unfrozen neighbors of the new added node i only have influence range over tree 
structures, which means that the double edges belonging to different unfrozen neighbors are 
disconnected except i. At this time, these unfrozen neighbors can not propagate its influence 
to each other, and they can take —1 simultaneously. Similar as that in random graph, as 
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Cycle 1-Incompatible Cycle [ 
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Cycle 2-Compatible Cycle 



FIG. 3. The above subgraph provides the process of case A to produce the mutual-determination 
structure, and the below subgraph reveals the formation of incompatible cycle and compatible cycle 
by interaction. 



the increasing of the number of nodes and edges, the unfrozen nodes with double edges in 
the reduced solution graph may connect together, and form cycles and even giant connected 
component. Especially, for random graphs, the cycles connected by unfrozen nodes in the 
reduced solution graph must be with size of 0{logN). Therefore, if the unfrozen nodes 
connect together to form a giant connected component 



28l |. some of them taking value 
— 1 will cause a percolation phenomenon j27| that many other nodes {0{N)) in this giant 
connected component will be forced to be frozen. As a result, the long-range correlation 

n 

phenomenon emerges. In the work of Zhou p^, the long-range correlation of Vertex-cover 
for random graph appears at c = e. Indeed, by the literature of statistical mechanics, the 
existence of long-range correlation has close connection with the replica symmetric breaking 
of the solution space. As the correlation is formed by mutual-determinations, the long-range 
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correlation can also provide an explicit explanation of the clustering phenomenon of solution 
space. 

By the emergency of the long-range correlation nodes, the local environment becomes 
much more complicated. As unfrozen neighbors of the new added node i can be connected 
together by other unfrozen nodes, their values can not be assigned arbitrarily. In Figure 
3, a schematic view of the compatible and incompatible cycles of unfrozen nodes is shown. 
In Cycle 1, the unfrozen nodes ^1,^2 are connected by unfrozen nodes with alternatively 
existing double edges, and it is easy to find that the nodes fci, ^2 form a long-range correlation 
relation and can not take spin value —1 simultaneously. To the contrary, in the compatible 
Cycle 2, though the relation between j^jm-i is also long-range correlation, they can take 
spin value —1 simultaneously by the mutual-determination chain in Cycle 2. 

MUTUAL-DETERMINATION AND BACKBONE EVOLUTION ALGORITHM 
FOR VERTEX-COVER 

In this section, we will introduce an algorithm for solving Vertex-cover based on case A-E 
and the node ranks. By the analysis in case A, B, C, D, E, we consider to update the state of 
the original graph G{N — 1) after adding a new node i. As the node states are classified by 
mutual-determinations and backbones, we can get an algorithm to find the reduced solution 
graph R{G) of Vertex-cover, this algorithm is named Mutual- determination and Backbone 
Evolution Algorithm^ shown as follows: 

Let's take G[v] as an induced subgraph of original graph G by adding node v and 
Eij = 0(1) represent nodes i and j are connected (unconnected). Especially, when nodes 
i and j form the mutual-determination, we take Eij — 2. backbone[i] = —1,0 or 1 means 
the node i is unfrozen, positively frozen or negatively frozen node respectively; root[i] is the 
additional mark of node i. 

The algorithm of Releasing Operation is shown as follows: 
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algorithm Releasing(z,G,i?OOr) 
begin 

backbone[i] = — 1 ; 
root[i] = 0; 

for all neighbor j of z in G with root[j] — ROOT do 
begin 

ii{backbone[j] — 1 and j has at least one positively frozen 
neighbor k with root[k] ROOT) then 

continue; 
else do 

Releasing(j,G,i?OOr); 

end 

end 

The algorithm of Freezing Influence is shown as follows: 

algorithm Freezing(z,G) 
begin 

if{backbone[i] = 0) do 

for all unfrozen neighbor j of i in G do 

root[j] = root[i] ; 

backbone[j] = 1; 

Freezing(j,G); 
if{backbone[i] = 1) do 

for all unfrozen neighbor j of i in G with Eij — 2 do 

root[j] = root[i] ; 

backbone[j] = 0; 

Freezing(j,G); 

end 

Now, it is the algorithm of Mutual-determination and Backbone Evolution Algorithm: 
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begin 

calculate the leaf -removal sequence layer[i] of G] 
vertex set v = 0; 

initialize backbone[i] = —1 and root[i] — for all i in G; 

for / = 1 to Kax(layer[i],l < i < N) do 

begin 

for all vertex i with layer[i] — I do 
begin 

V = V Ui] 
G' = G[v]; 

calculate num is the number of positively frozen neighbors of i in G' 

if{num =1) do 

begin 

Pos is the positively frozen neighbor of i; 

if (unfrozen neighbors of i in G^ can take —1 simultaneously) then 

Ei^Pos = 2 ; 

Releasing {Pos , G' ^root [Pos] ) ; 

Rechecking technique and Odd cycles breaking; *Ca5e A* 

else do 

backbone[i] = 1 ; 

root[i] = i; "^Case D* 

end 

if {num > 2) do 
begin 

if (all frozen neighbors of i in G' have same additional mark and 
unfrozen neighbors can take —1 simultaneously) then 
Pos is one of neighbors of i randomly; 

Ei^Pos = 2 ; 

for all the neighbors j of i in G' do 
Releasing (j , [j] ) ; 

Rechecking technique and Odd cycles breaking; *Case E* 

else do 

backboneli] = 1 ; 

^ ^ 15 

root[i] = i; "^Case B* 



ii{num 0) do 
begin 

if (unfrozen neighbors of i in can take —1 simultaneously) then 

backbone[i] = 0; 
root[i] = i] 

Freezing(z,GO; C* 
else do 

backbone[i] = 1 ; 

root[i] = i; "^Case D* 

end 
end 
end 
end 



Some numerical results of the Mutual-determination and Backbone Evolution Al- 
gorithm 

In this section, some numerical experiments will be performed to verify the efficiency and 
performance of the Mutual-determination and Backbone Evolution Algorithm on random 
graphs. 

To reflect the solution space structures of Vertex-cover, the ratios of negatively frozen 
backbone and positively frozen backbones are detected by the algorithm, in which one is 
monotone increasing and the other is monotone decreasing. In Figure 4, the ratios of the 
backbones are shown by the solid triangles, and the unfrozen nodes have its ratio with the 
residual part of one. Our results on the frozen nodes in one macroscopic state is higher than 
that in [jjI mainly be the freezing influence. Besides, in Figure 5, the coverage of the Vertex- 
cover which is the size of the minimal vertex-cover is approximated by our algorithm, which is 
shown by the blue cycles with error bars and compared with the results of replica symmetry, 
replica symmetric breaking theory and survey propagation. The results on coverage of our 
algorithm perform better than that of replica symmetry when the average degree c is not very 
large, but still have a small gap with the results of replica symmetric breaking theory and 
survey propagation. By the proof of the strictness of Mutual-determination and Backbone 
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FIG. 4. Numerical results by our algorithm of fraction of positively frozen (red solid cycle) and 
negatively frozen (black solid rectangle) nodes with different mean degrees, which are obtained by 
1000 random instances with N = 5000 nodes; fraction of frozen vertices in one macroscopic state 
(yellow solid triangle) and its comparison with results of Ref.[17] (blue line for the fraction in all 
macroscopic states and blue dashed line for the fraction in one macroscopic state). 

Evolution Algorithm when c < e in the next section, our numerical results should be exact 
ones for the corresponding interval on random graphs. 

As a comparison to the complete algorithm and the exact coverage, some experiments 
are made to verify the performance of the Mutual-determination and Backbone Evolution 
Algorithm which is an incomplete algorithm. In Figure 6, average Error of minimal vertex 
cover between experimental and exact results are plotted to provide the difference between 
the exact results and our results on the coverage, and it is evident to see that these differences 
are not very big and have their scales no more than 0.04 for c = 2, 4, 6 with increasing sizes. 



Mutual-determination and Backbone Evolution Algorithm on some examples 

To detect the reduced solution graph and provide a primary analysis of efficiency of our 
algorithm on the leaf-removal core, we will discuss the Vertex-cover on the complete graphs 
and cycles with even number of nodes for inspiration. 

For the complete graphs, the process of our algorithm to obtain the reduced solution graph 
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FIG. 5. Numerical results for Vertex-cover by our algorithm. The blue cycles with error bar 
denote the minimal coverage ratio by our algorithm with N = 5000 and 1000 random instances; 
the brown rectangles and triangles denote the results of replica symmetric breaking theory and 
survey propagation respectively; the purple line denotes the results by replica symmetry theory; 
the dashed line represents mean degree c = e. 

is rather simple: when the second node is added with an edge (subgraph (1) in Figure 7), 
the mutual-determination emerges; for the following added nodes, their local environment 
satisfies the case D and they can only be negative backbones. This process is shown in 
Figure 7 by a typical graph K^. It is easy to know that for the complete graph there 
must be — 1 nodes be covered, and our results of reduced solution graph correspond to a 
solution subspace of the Vertex-cover of K^. The whole solution space possesses solutions 
and by our algorithm we can obtain 2 solutions. Therefore, the mutual-determination and 
Backbone Evolution Algorithm is an incomplete algorithm for the solution space, but it 
may be efficient for finding one solution of Vertex-cover. Certainly, as analyzed in the above 
section, the incompatible cycles of the unfrozen node will bring the intrinsic difficulty for 
solving it and our algorithm can only obtain some approximated solutions for the original 
problem. 

Then, the cycles C2N with even number of nodes are considered. The process of our 
algorithm to obtain its reduced solution graph is a regular process: when odd number of 
nodes are added, there are no unfrozen nodes in the reduced solution graph; when even 
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FIG. 6. Average Error of minimal vertex cover between experimental and exact results. All 
results are obtained by 1000 random instances with c = 2, c = 4 and c = 6 with different size 
7V = 20,30,---,150. 

number of nodes are added, the releasing operations should be considered and all the nodes 
are unfrozen with double edges/mutual-determinations alternatively connected together; for 
the last node, it connects with two positively frozen nodes which have the same additional 
mark 2N — 1, and by the case E the last node forms mutual-determination with node 2N — 1 
and the rest are released. The whole process is schematically shown in the lower subgraphs 
(a — d) in Figure 7 by a typical graph (^4. Thus, the solution space of C2N can be obtained, 
and it is easy to verify that the result is strict by our algorithm. 



ANALYSIS OF MUTUAL-DETERMINATION AND BACKBONE EVOLUTION 
ALGORITHM FOR VERTEX-COVER 

The Mutual-determination and Backbone Evolution Algorithm aims to obtain the whole 
solution space, and it is easy to find that it is an algorithm of polynomial time. As the Vertex- 
cover problem is a typical NP-complete problem, this algorithm can not be a complete one 
and will lose its efficiency in some case. In this section, some detailed analysis on the 
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FIG. 7. The above subgraphs provides the process of obtaining the reduced solution graph of 
complete graphs, which is shown by the complete graph with 5 node in this figure. The below 
subgraphs provides the process of obtaining the reduced solution graph of even cycles. 

algorithm will be provided. 



The time complexity of Mutual-determination and Backbone Evolution Algorithm 

By the algorithm in the above section, the process of determining the ranks of the nodes 
in the graph is intrinsically a leaf removal process, and it will cost at most 0{N) steps to 
obtain the whole ranks of all the nodes. 

By considering the nodes sequentially according to their ranks, when adding a new node 
to the original graph, first we should consider its local environment, which will cost at most 
constant C steps for random graph. Then, in different cases A-E, there may be additional 
time cost. In case B and D, the current state of the new added node is only determined by 
its neighbors and it causes no influence to others; In case C, the freezing of the current node 
will cause an influence to the unfrozen neighbors and those related to them, and thus the 
influence propagation will cost at most 0{N) steps; In case D, the releasing operation with 
the checking technique will cost at most 0{N) steps. At last, the rechecking technique and 
odd cycle breaking will cost at most 0{N) steps for changing the states of some nodes. In 
sum, when a new node is added to the graph, there are at most C + 0{N) + 0{N) = 0{N) 
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FIG. 8. Then existence of cycles with non- alternatively mutual-determinations and the existence 
of the even cycles with alternatively mutual-determinations when leaves are removed. 

steps to obtain the new reduced solution graph. 

Besides, by the node ranks, there are nodes to be added in total. Therefore, the 
total time cost for the Mutual-determination and Backbone Evolution Algorithm is at most 
0{N) + N ^ 0{N) = 0{N^) steps for random graphs. 

The strictness of Mutual-determination and Backbone Evolution Algorithm 

In this subsection, we will discuss the strictness of the Mutual-determination and Back- 
bone Evolution Algorithm. By the analysis in section 3, Vertex-cover can be solved in 
polynomial time by assigning the pendants +1 and their petioles —1 when there is no leaf 
removal core. Indeed, if all the nodes can be assigned ranks by the leaf-removal, i.e., the 
leaf-removal core is null, the reduced solution graph can reveal the whole solution space of 
Vertex-cover strictly and our algorithm is a complete one to obtain the whole solution space 
in this case. The proof is given in the following. 

Proof: For each pair of leaf, they form mutual-determination or both are backbones with 
one positive and the other negative. Our algorithm is intrinsic an evolution process for the 
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two kinds of states of leaves. 

When the reduced solution graph is with unfrozen-node structures of trees or forests for 
each step of the algorithm, this evolution guarantees that each step of adding a leaf will 
obtain the whole solution space of the enlarged graph. The strictness of operations in case 
B is trivial. Mainly by the case A and C, the releasing operation and freezing influence are 
alternatively changing the states on the trees or forests and have no cross influence among 
different branches, which leads to the strictness of our algorithm. 

When the reduced solution graph is with unfrozen-node structures of odd cycles in some 
steps, the odd cycles breaking technique ensures the correctness of the algorithm and the 
resulted reduced solution graph can be reduced to the case of unfrozen-node structures of 
trees or forests above. 

The reduced solution graph can never have even cycles with alternative existing mutual- 
determinations when there is no leaf-removal core. In the right subgraph of Figure 8, a 
schematic view for the leaf removal is provided. All the nodes in the red circles will be 
removed in pairs by leaf removal process, and all nodes {a, 6, c, rf, e, /, 5^, /i} can only have 
their own leaf partners on this cycle, which means that there are no new leaves after the nodes 
in the red circles are removed and the even cycle formed by {a, 6, c, d, e, /, h} survivals at 
last. Evidently, the even cycles will be in the leaf-removal core. 

Cycles of unfrozen nodes without alternative existing mutual-determinations can survive 
on the reduced solution graph. In the left above and below subgraphs of Figure 8, two 
simple examples are given to reveal the existence of ordinary cycles of unfrozen nodes on 
the reduced solution graph. By simple logic, we can find that each node on the graphs can 
have both covered and uncovered states. In this situation, the strictness of our algorithm 
is guaranteed by the checking and rechecking techniques and the case E, which ensure that 
the influence of the freezing operation and releasing operation can be controlled in a correct 
way. 

At last, considering case D, when the leaf-removal core is null, this case can be reduced 
to the odd cycle breaking, and it will bring the kernel difl&culty when the leaf-removal core 
exists. 

Therefore, the reduced solution graph obtained by our algorithm can reveals the exact 
solution space when there is no leaf-removal core. □ 

By the above analysis, we have shown that the Mutual-determination and Backbone 
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Evolution Algorithm is strict when there is no leaf-removal core in the graph. By the results 



m 



29| . there is no leaf-removal core in the random graph with high probability when the 



average degree c is less than e. Then, our algorithm is strict with high probability when 
c < e. 



Cycles in the reduced solution graph 

The even and odd cycles of unfrozen nodes will be analyzed in this subsection. In this 
right subgraph of Figure 8, the nodes {a, 6, c, rf, e, /, 5^, /i} with four mutual-determination 
(a, 6), (c, e), (rf, /), {g^ h) construct an even cycle of unfrozen nodes. Indeed on this cycle all 
the nodes have a mutual-determination relation, that is to say, that any node is covered of 
uncovered will lead to the fixation of all the other 7 nodes. Then, the double edges can also 
be drawn on (a, c), (6, rf), (/, /i), (e, g) or all the edges, all these expressions on the reduced 
solution graph correspond to the same solution space and there are only two solutions on the 
even cycles of alternative mutual-determinations. For the odd cycles of alternative mutual- 
determinations, e.g., subgraph (7) of Figure 2, what we can do is to perform the odd cycle 
breaking, which keeps the strictness of our algorithm. 

Unfortunately, there is the other way to produce an odd cycle of alternative mutual- 
determinations, just like the Incompatible Cycle in the below subgraph of Figure 3. This 
kind of odd cycle structure emerges when the leaf-removal core exists and is hard to be 
broken for the lowest energy configuration of Vertex-cover. As the incompatible cycle brings 
obstacle for obtaining the real reduced solution graph, changing any unfrozen node on it to 
be negatively frozen is a possible choice for the reduced solution graph. In our algorithm, we 
can only choose one way to proceed, which makes the solution space collapse to a subspace. 
Many steps of the collapsing may lead to unnecessary energy increase and superfiuous cover 
of the graph. 

In fact, we can keep all the incompatible cycles of alternative mutual-determinations 
without breaking choices for each step in the leaf-removal core and deal with them for the 
final reduced solution graph. All the backbones have no infiuence on the solution space, 
but breaking the incompatible cycles of alternative mutual-determinations on the reduced 
solution graph is an urgent task for achieving the proper solution subspaces. Many these 
incompatible cycles are coupled together and should be broken by making some nodes on 
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them negatively frozen. The fewer the number of negatively frozen nodes are chosen, the 
better covers we can obtain. Therefore, this problem can be reduced to the MAX-CUT js^ 
problem for the unfrozen nodes of the reduced solution graph. By the results of MAX-CUT, 
breaking the edges of unfrozen nodes which do not belong to the max-cut will lead to totaly 
compatible cycles. However, the MAX-CUT problem is also a NP-complete problem which 
is hard to solve. 



CONCLUSION AND DISCUSSION 

A new solution space structure, mutual-determination between unfrozen nodes is de- 
fined and discovered in some detailed case of the Vertex-cover. Based on the mutual- 
determinations and backbones, we construct the reduced solution graph to reveal the solu- 
tion space of Vertex-cover. And, inspired by the leaf removal process and introducing node 
ranks, a dynamical process for the evolution of the node states is studied to achieve the 
current states of nodes in the reduced solution graph. Combing the mutual-determinations, 
backbones and the node ranks, an algorithm named Mutual-determination and Backbone 
Evolution Algorithm is proposed to obtained the accurate reduced solution graph. To ensure 
the accuracy of the algorithm, the releasing operations, checking and rechecking techniques 
and odd cycles breaking operation are defined by considering the infiuence propagation. 
Then, the numerical results and some examples are given to verify the validity of the al- 
gorithm. Besides, we have proved that this algorithm is an 0{N'^) algorithm and performs 
strict when there is no leaf-removal core for the graph, the infiuence of incompatible cycles 
of unfrozen nodes to the algorithm is given, which can be reduced to MAX-CUT problem. 

The Mutual-determination and Backbone Evolution Algorithm can be applied to a wide 
range of graphs. Though the difiiculties are brought to by the incompatible cycles in case D 
on the reduced solution graph, choosing proper strategies to break the cycles will be helpful 
to obtain a solution subspace, which will be beneficial to solve the Vertex-cover problem in 
different topologies. Besides, in order to break the incompatible cycles of unfrozen nodes 
in case D on the reduced solution graph, we should design better heuristic strategies to 
check the key unfrozen nodes on it, such as taking advantage of the centrality or clustering 
coefficient 0, Q. However, as the intrinsic character of Vertex-cover is NP-complete, the 
Mutual-determination and Backbone Evolution Algorithm will still be an approximated one, 
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and what we aim at is to improve the accuracy of solving different graphs of Vertex-cover. 



The reduced solution graph of Mutual-determination and Backbone Evolution Algorithm 
can correspond to the whole solution space of Vertex-cover in some cases, which is a great 



help to count the number of solutions. Similar as the #CSP |3l|, l32|], the #Vertex-cover can 
be analyzed based on the reduced solution graph. However, calculating the exact entropy of 
the solution space needs a much detailed analysis of the constructions of the reduced solution 
graph and there should be many techniques to be introduce on counting the solutions on the 
reduced solution graph. Besides, the reduced solution graph can help explicitly determine 
the role of every node and calculate the partition functions and marginal probabilities of the 
nodes/ variables. Some of the related results will be proceeded in our future work. 

The principal of our algorithm is related to the replica symmetry theory but not restrict 
to. Most of recent algorithms solving combinatorial optimization problems always concen- 
trate to find one solution, such as the searching algorithms, heuristic algorithms and even 



the Belief/ Survey Propagation algorithm |l5 



2l| . They assign values to the nodes/ variables 



according to some strategies and do backtracking to reach the optimal solution, or determine 
the probability of the variables taking some values. The Mutual-determination and Back- 
bone Evolution Algorithm collects as more solutions as possible for the initial subgraphs, and 
aims to find solutions by contracting the solution space. At least, algorithms of detecting 
the solution space provides a strategy of reducing the complexity of finding solutions, and 
combing our algorithm with other searching and heuristic algorithm may be an interesting 
research direction for accelerating the solving process. 
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